REPORT  DOCUMENTATION  PAGE 


Pii)lc  reportino  burden  for  this  collection  of  Information  is  estimated  to  average  t  hour  per  response,  including  the  time  forn 
the  collection  of  Information.  Send  comments  regarding  tNs  burden  estimate  or  any  other  aspect  of  tNs  collection  of  in 
Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlngton,  VA  22202-4302.  und  to  the  Office  of  Mana 


AFRL-SR-BL-TR.98- 


1.  AGENCY  USE  ONLY  (Leave  blank) 


4.  TITLE  AND  SUBTITLE 


2.  fiEPORT  DATE 


3  Feb  97 


ded,  and  completing  and  reviewing 
vices.  Directorate  for  Information 


3.  REPORT  TYPE  AND  DATES  COVERED 

FINAL  TECH  RPT,  01  JAN  94  TO  31  DEC  96 


5.  FUNDING  NUMBERS 


New  Concepts  in  Computer  Simulation-Surrogates 


F49620-94-1-0121 


6.  AUTH0R{S} 


Professor  Anthony  T.  Patera 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS{ES) 

Dept  of  Mechanical  Engineering 
Massachusetts  Institute  of  Technology 
77  Massachusetts  Avenue 
Cambridge  MA  02139 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

AFOSR/NM 

110  Duncan  Avenue  Suite  B 115 
Bolling  AFB  DC  20332-8050 

11.  SUPPLEMENTARY  NOTES 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


10.  SPONSORING/MONITORI 
AGENCY  REPORT  NUMBI 


12a.  DISTRIBUTION  AVAILABILITY  STATEMENT 


Approved  for  public  release;  distribution  unlimited. 


1 3.  ABSTRACT  (Maximum  200  words) 

Although  the  advent  of  fast  and  inexpensive  parallel  computers  has  rendered  numerous  previously 
intractable  calculations  feasible,  many  numerical  simulations  remain  too  resource  intensive  to  be  directly 
inserted  into  engineering  optimization  efforts.  An  alternative  to  direct  insertion  considers  models  for 
computational  systems:  the  expensive  simulation  is  evoked  only  to  construct  and  validate  a  simplified 
input-output  model;  fliis  simplified  input-output  model  then  serves  as  a  simulation  surrogate  in  subsequent 
engineering  optimization  studies.  As  compared  to  the  direct  insertion  approach,  surrogates  offer  more 
complete,  efficient,  and  robust  optimization,  greater  accommodation  of  prior  information,  broad 
applicability  to  families  of  objective  functions,  and  a  more  interactive,  flexible  design  environment. 

In  this  project,  a  validated  surrogate  metliodology  was  developed  which  permits  economical  and 
reliable  integration  of  large-scale,  possibly  noisy  numerical  simulations  into  engineering  design  and 
optimization  studies.  The  project  included  both  tlie  fonnulation,  analysis,  and  implementation  of 
construction-validations  algorithms,  and  the  application  of  tlie  resulting  techniques  to  problems  of  scientific 
and  engineering  interest.  The  sample  application  are  intended  to  be  sufficiently  simple  to  permit  numerical 
experiment,  yet  sufficiently  complex  to  properly  stimulate,  constrain,  and  demonstrate  the  proposed 
methodology. 


14.  SUBJECT  TERMS 


parallel  computers,  robust  optimization 


mm  qUMJTY 


15.  NUMBER  OF  PAGES 

r.GTSD  ^ _ L- 

16.  PRICE  CODE 


17.  SECURITY  CLASSIFICATION 
OF  REPORT 

Unclassified 


IB.  SECURITY  CLASSIFICATION 
OF  THIS  PAGE 

Unclassified 


19.  SECURITY  CLASSIFICATION 
OF  ABSTRACT 

Unclassified 


20.  LIMITATION  OF 
ABSTRACT 


Standard  Form  298  (Rev.  2-89)  (EG) 

Prescribed  by  ANSI  Std.  239.18 

Desigrred  using  Perform  Pro,  WHS/OIOR,  Oct  94 


19980129  053 


FINAL  REPORT 


AFOSR  Grant  F49620-94-1-0121 


“New  Concepts  in  Computer  Simulation-Surrogates” 


Principal  Investigator: 

Anthony  T.  Patera 

Professor  of  Mechanical  Engineering 
Massachusetts  Institute  of  Technology 
Room  3-266 

77  Massachusetts  Avenue 
Cambridge,  MA  02139 


February  3,  1997 


OVERVIEW 


Although  the  advent  of  fast  inexpensive  parallel  computers  has  rendered  numerous 
previously  intractable  calculations  feasible,  many  numerical  simulations  remain  too 
resource-intensive  to  be  directly  inserted  into  engineering  optimization  efforts.  An 
attractive  alternative  to  “direct  insertion”  considers  models  for  computational  systems:  the 
expensive  simulation  is  evoked  only  to  construct  and  validate  a  simplified  input-output 
model;  this  simplified  input-output  model  then  serves  as  a  simulation  surrogate  in 
subsequent  engineering  optimization  studies.  As  compared  to  the  direct-insertion 
approach,  surrogates  offer  more  complete,  efficient,  and  robust  optimization,  greater 
accommodation  of  prior  information,  broad  applicability  to  families  of  objective  functions, 
and  a  more  interactive,  flexible  design  environment. 

In  this  project  we  have  developed  a  validated  surrogate  methodology  which  permits 
economical  and  reliable  integration  of  large-scale  (possibly  noisy)  numerical  simulations 
into  engineering  design  and  optimization  studies.  The  project  includes  both  the 
formulation,  analysis,  and  implementation  of  construction-validation  algorithms,  and  the 
application  of  the  resulting  techniques  to  problems  of  scientific  and  engineering  interest. 
The  sample  applications  are  intended  to  be  sufficiently  simple  to  permit  numerical 
experiment,  yet  sufficiently  complex  to  properly  stimulate,  constrain,  and  demonstrate  the 
proposed  methodology. 

Finally,  we  have  interacted  with  United  Technologies  Research  Center  (UTRC)  in  two 
small  grants  which  “leveraged”  the  AFOSR  funding.  The  first  grant,  involving  the 
integration  of  our  methods  into  the  UTRC  simulation-based  optimal  design  program,  led  to 
the  application  of  our  methods  to  certain  problems  of  interest  to  Pratt  and  Whitney.  The 
second  grant  focused  on  the  particular  issue  of  the  effect  of  manufacturing  tolerances  on 
simulation-based  design  predictions. 


TECHNICAL  ACCOMPLISHMENTS 

1 .  Basis  Framework.  The  basic  notions  of  construction,  validation,  and  a  posteriori  error 
analysis  are  described  in  [1],  with  extension  to  the  case  of  noisy  outputs  in  [2].  The 
essential  element  of  the  framework  is  a  nonparametric  validation  procedure  that  leads  to  a 
“probably  approximately  correct”  error  statement  which  then  serves  in  the  a  posteriori 
analysis  to  estimate  system  predictability,  optimality,  and  stability. 

2.  Algorithmic  Improvements  and  Extensions.  The  basic  techniques  have  been  enhanced 
to  permit:  unbiased  comparison  and  selection  of  competing  candidate  surrogates;  elemental 
cross-validation  procedures  that  permit  the  same  simulation  result  to  serve  in  both 
construction  and  validation;  sequenti^  validation  techniques  that  permit  construction  and 
validation  simulations  to  be  deployed  only  as  necessary,  eliminating  overconstruction  and 
underconstruction  as  sources  of  inefficiency  and  inaccuracy,  respectively;  and  adaptive 
construction  and  validation  procedures  that,  based  on  local  error  estimators  and  sequential 
concepts,  permit  simulation  results  to  be  deployed  only  where  needed  in  the  design  space. 
In  addition,  we  have  developed  several  new  approaches  to  input  noise  and  sta.bility,  simpler 
optimality  metrics,  multipoint  “nonparametric-average”  error  estimates,  effective  error 
scalings  for  multiple  outputs,  and  nested  validation  schemes  based  on  a  hierarchy  of 
models.  These  results  are  described  in  [3,4,5]. 


1 


3.  Identification  of  Critical  Issues.  Through  the  work  described  above,  it  has  become 
clear  that  the  most  important  remaining  issue  is  the  treatment  of  problems  with  many  inputs 
-  a  common  situation  in  many  industrial  situations.  We  have  identified  certain  new 
techniques  which,  as  an  ensemble,  should  significantly  improve  our  capability  to  address 
such  problems. 

The  first  ingredient  is  a  Pareto  optimization  framework  which,  based  on  rational 
engineering  design  criteria,  identifies  and  focuses  on  an  appropriate  lower-dimensional 
subset  of  the  entire  design  space.  The  method  has  been  applied  successfully  to  several 
problems  in  optimal  control  and  shape  optimization. 

The  second  ingredient  is  better  construction  (approximation)  techniques  that  can 
yield  good  models  based  on  relatively  little  expensive-simulation  data.  Towards  this  end, 
we  have  initiated  development  of  Proper-Orthogonal-Decomposition  methods  that  should 
perform  significantly  better  than  simple  input-output  interpolant  (or  fitting)  schemes.  The 
essential  point  is  that  POD  techniques  are  based  on  a  low-dimensional  state  space,  and  are 
thus  much  better  able  to  capture  complex  dynamics  than  techniques  which  do  not  exploit 
the  underlying  structure  of  the  governing  equations.  POD  techniques  should  thus  offer 
much  better  accuracy  with  less  data  and  fewer  modes.  Application  to  several  simple 
problems  has  demonstrated  this  claim. 

The  third  ingredient  is  a  new  error  estimation  technique  that  will  significantly 
decrease  the  cost  of  validation  by  permitting  expensive  truth  calculations  to  be  replaced  by 
inexpensive  but  accurate  lower  and  upper  bounds.  The  methodology  is  based  upon 
concepts  from  partial-differential-equation  a  posteriori  error  analysis,  extended  to  permit  the 
consideration  of  realistic  (e.g.,  linear-functional)  outputs.  At  present  only  a  limited  number 
of  problems  can  be  treated  by  this  method,  but  the  technique  is,  in  theory,  quite  general, 
and  should  find  broad  applicability. 

The  three  new  ingredients  described  above  have  been  evaluated  in  certain  simple 
contexts,  but  much  work  remains  to  extend  the  ideas  so  that  they  can  be  applied  to  the 
complex  problems  encountered  in  industrial  engineering  design  and  optimization.  This  is 
the  topic  of  our  renewal  grant,  recently  awarded  by  AFOSR. 
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